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(54) System for network transcoding of multimedia data flow 

(57) A service provider node has an active network 
daemon running on it Users control an adaptive pipe- 
line via the active network capability of the service pro- 
vider node by sending coded instructions to the service 
provider node. An adaptive pipeline is constructed 
within the service provider node according to control 
parameters contained in the coded instructions sent to it 
by a user. The adaptive pipeline includes a decode and 
an encode stage with zero or more intermediate filtering 
stages. The number and type of intermediate stages is 
determined by the values of the specified flow parame- 
ters. 
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Description 

Background of the invention 

[0001] The present invention relates in general to 
transcoding, and more particularly to network transcod- 
ing of multimedia data flow. 

[0002] Distributed multimedia applications require 
communications support mechanisms with multiple cli- 
ents on a network. Referring to Fig. 1 , networking capa- 
bility of a network node (a computer residing on a 
network) is divided into several layers that interface with 
each other. This is called the network stack Starting 
from the bottom of the network stack, the physical net- 
work interface is responsible for receiving the electronic 
signals that come across the network wire. Moving up 
the stack the network signals are decoded further and 
passed to the next stack until the application layer is 
reached. It is this layer where the network traffic is inter- 
preted in such a way that a response can be communi- 
cated to network clients to satisfy the ultimate service 
request by that client, such as a request for particular 
multimedia data flow. 

[0003] Such network traffic needs to be delivered to 
end-systems, networks and end-users in a form that 
they can handle while satisfying the constraints 
imposed by the application. Quality of Service (QOS) 
mechanisms that allow full quality multimedia data play- 
out on high-performance stations, while at the same 
time providing appropriately filtered lower quality play- 
out perhaps in a different coding format, at other end 
systems is called transcoding. However, current trans- 
coders cannot scale, cannot adapt and are not flexible. 
[0004] What is desired is a system for network 
transcoding of multimedia data flow wherein users can 
program a transcoding resource across the network and 
have a custom transcoder, so to speak, tat scales, is 
adaptable and flexible. 

Summary of the invention 

[0005] In accordance with the illustrated preferred 
embodiment of the invention, a service provider node 
has an active network daemon running on it Users con- 
trol an adaptive pipeline via the active network capabil- 
ity of the service provider node by sending coded 
instructions to the service provider node. After inter- 
cepting a network client request for transcoding, an 
adaptive pipeline is constructed within the service pro- 
vider node according to control parameters contained in 
the coded instructions sent to it by a user. The adaptive 
pipeline includes a decode and an encode stage with 
zero or more intermediate filtering stages. The number 
and type of intermediate stages is determined by the 
values of the specified flow parameters. The multimedia 
data flow requested by the network client is then proc- 
essed through the adaptive pipeline and the resulting 
transcoded multimedia data flow is sent to the network 



client that requested it. 

[0006] The objects, advantages, and other novel 
features of the present invention are apparent from the 
following detailed description when read in conjunction 
5 with the appended claims and attached drawing. 

Brief Description of the Drawing 

[0007] 

10 

Fig. 1 is a block diagram of the layers of a network 
stack. 

Fig. 2 is a block diagram of a system for network 
75 transcoding according to the present invention. 

Fig. 3 is a block diagram of an adaptive pipeline 
according to the present invention. 

20 Description of the Preferred Embodiment 

[0008] Referring to Fig. 1, the present invention 
operates at the application layer of the network stack, 
and therefore no change is required in current network 

25 protocols such as IP (Internet Protocol), and standard- 
ized packet format and addressing schemes are used. 
[0009] Referring to Fig. 2, a network client 10 
launches a request for service over a network 8. A serv- 
ice provider node 11 residing on the network 8 has a 

30 program running called an active network (AN) daemon 
6. The AN daemon 6 provides a programmable open 
node so that network users may deploy programs 
dynamically into node engines. The service provider 1 1 
intercepts the request and the AN daemon 6 forks a 

35 child process 5 corresponding to the service requested 
from a plurality of services that may be available. 
According to the present invention the service that is 
requested is transcoding. The AN daemon 6 then 
parses the request for service and loads specific control 

40 parameters specified in the request for service into a 
data structure. The control parameters are specified by 
a network user and include, but are not limited to: 

1. Command Type (e.g. Connection request) 

45 

2. Ports (channel identifications) 

3. Media Type 
so 4. Bit-Rate 

5. Frame Rate 

6. Resolution 

55 

7. End-to-End Latency 

8. Interlace 
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9. Signature 

10. Loss Percentage 

1 1 . Content Identification 

12. Code Type 

13. Rlter 

14. Rlter Parameter 

15. Prediction 

16. Hostname 

[0010] The relationship between a parent and child 
process is such that the parent process (AN daemon 6) 
and the child process 5 are running concurrently within 
the network node 11 and therefore may communicate 
with each other through parameters. 
[001 1 ] The child process 5 hosts an adaptive pipe- 
line 4 in order to provide transcoding service. Referring 
to Fig. 3, an adaptive pipeline 4 is a set of modular com- 
ponents, each component implementing one transfor- 
mation to a data stream. The data stream in the 
preferred embodiment is multimedia data flow being 
sent to the service provider node 11, such as Moving 
Picture Experts Group standards 1 -4 (MPEG-1 , NIPEG- 
2, MPEG-4), Joint Photographic Experts Group (JPEG), 
H.263, H.261 , but is not limited to those standards. The 
head end stage of the pipeline 4 is a decoder engine 20 
for the particular standard requested for transcoding, 
while the tail end 24 is an encoder engine 26 for the par- 
ticular standard requested to be the result of the trans- 
coding. The intermediate stages 22 are those that allow 
adjusting of the quality of baseband multimedia data 
flow in order to transcode the data flow. These include, 
but are not limited to: horizontal filtering, vertical filter- 
ing, mosquito filtering and adaptive interpolation. Buffer 
pools 12, 14, 16, 18 fulfill the memory requirements of 
the particular stages of the adaptive pipeline 4. 
[0012] Referring to Fig. 2, The AN daemon 6 
passes the control parameters to the adaptive pipeline 4 
by passing the data structure containing the control 
parameters to the child process 5 hosting the adaptive 
pipeline 4. Referring to Fig. 3 the adaptive pipeline is 
configured according to the control parameters. The 
child process calls action functions to perform the 
decode 20, filter 22 or encode 24 stage of the adaptive 
pipeline 4 and these in turn select an appropriate func- 
tion to transcode the multimedia data flow requested by 
the network client 1 0 according to the encode or decode 
code type and the other configurations specified by the 
control parameters. This allows the pipeline 4 itself and 
individual stages of the pipeline to be configurable 
across the network by users specifying values of flow 
parameters. 



[001 3] The intermediate stage(s) 22 of the pipeline 
4 however, are optional and there could be more than 
one intermediate stage. The intermediate stage(s) 22 
are a function of the amount of filtering desired, which is 

5 specified in the flow parameters mentioned above. On 
the simple side, an MPEG-2 to H.263 transcoding 
requires at least horizontal and vertical filtering in the 
intermediate stages 22. On the more complex side, the 
filtering could be so exhaustive that certain combina- 

10 tions would not fit in a stage, and therefore combina- 
tions are split into multiple intermediate stages 22. For 
example, if adaptive interpolation is a type of filtering 
requested, and horizontal/vertical filtering are still 
required, the choice is to add another stage. Which 

75 combinations fit into a stage and in what order is active- 
node intelligence captured in tables. If a user requests a 
large amount of filtering it results in multistage filtering, 
and therefore more end-to-end latency. This is not 
desired for video conferencing but is perhaps accepta- 

20 We for just browsing. For real-time interaction, like in 
video conferencing, it is desirable to request an amount 
of filtering that requires either just one, or no stage at all. 
The significance of the one filtering stage is that it can 
serve as a synchronization port as well. 

25 [0014] The Node Operating System (NodeOS) of 
the service provider node 11 according to the preferred 
embodiment is an off-the-shelf real-time operating sys- 
tem REACT, an extension of the IRIX operating system 
provided by SGI, Inc., but any other real-time NodeOS 

30 may be used which has the following general character- 
istics. REACT NodeOS provides interface for activ- 
ity/thread mapping and support for real-time frame- 
based scheduling and related context switching. A nom- 
inal period of a few milliseconds is set, with program- 

35 ming for phantom frame injection. This results in elastic 
behavior of the frame boundary, which is a desirable 
property of soft real-time applications, especially when 
the same set of resources are being shared by multiple 
sessions. This particular NodeOS provides limited mon- 

40 rtoring facilities that the adaptive pipeline 4 may use for 
adaptive behavior. Overrun (crossing stipulated frame 
boundary) condition is the most common monitor used. 
NodeOS also provides system calls to administer 
resource usage. This input is used by an admission- 

45 control engine to limit new channel buildup. 

[0015] Referring to Fig. 2, the transcoded data flow 
resulting from the process of the adaptive pipeline 4 is 
then sent over the network 8 to the network client 10 
that requested it. The data is consistent with the format 

so requested by the network client 10 according to the flow 
parameters in the request for service. 
[0016] Thus, the present invention provides a sys- 
tem for network transcoding of multimedia data flow 
wherein users program a transcoding resource across 

55 the network and have a custom transcoder, so to speak, 
that scales, is adaptable and flexible. 
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Claims 

1. A method for network transcoding of multimedia 
data flow comprising the steps of: 

5 

receiving from a network client by an active 
network daemon a request for service contain- 
ing flow parameters; 

decoding multimedia data flow, requested by 10 
the request for service in a way determined by 
the flow parameters in the request for service; 

encoding the decoded multimedia data flow in 
a way determined by the flow parameters in the is 
request for service .thereby producing trans- 
coded multimedia data flow; and 

transmitting the transcoded multimedia data 
flow to the network client. 20 

2. A method for network transcoding of multimedia 
data flow according to claim 1 further comprising, 
after the decoding step, the step of filtering the 
decoded multimedia data flow in a way determined 25 
by the flow parameters in the request for service, 

the filtered decoded multimedia dataflow being 
input to the encoding step. 

3. A method for network transcoding of multimedia 30 
data flow according to claim 1 or 2 wherein the flow 
parameters indicate at least one of the following: 
command type, ports, media type, bit-rate, frame 
rate, resolution, end-to-end latency, interlace, sig- 
nature, loss percentage, content identification, 35 
code type, filter, filter parameter, prediction, host- 
name. 

4. An apparatus for network transcoding of multimedia 
data flow comprising: 40 

means for receiving from a network client by an 
active network daemon a request for service 
containing flow parameters; 

45 

means for decoding multimedia data flow 
requested by the request for service in a way 
determined by the flow parameters in the 
request for service; 

50 

means for encoding the decoded multimedia 
data flow in a way determined by the flow 
parameters in the request for service, thereby 
producing transcoded multimedia data flow; 
and 55 

means for transmitting the transcoded multime- 
dia data flow to the network client 
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5. An apparatus for network transcoding of multimedia 
data flow according to claim 4 further comprising 
means for filtering the decoded multimedia data 
flow in a way determined by the flow parameters in 
the request for service, if any filtering is desired as 
indicated by the flow parameters. 

6. An apparatus for network transcoding of multimedia 
data flow according to claim 4 or 5 wherein the flow 
parameters indicate at least one of the following: 
command type, ports, media type, bit-rate, frame 
rate, resolution, end-to- end latency, interlace, sig- 
nature, loss percentage, content identification, 
code type, filter, filter parameter, prediction, host- 
name. 

7. An apparatus for network transcoding of multimedia 
data flow comprising: 

a service provider node having an active net- 
work daemon capable of receiving a request 
for service containing flow parameters from 
network clients; 

an adaptive pipeline to transcode multimedia 
data flow in a way determined by the flow 
parameters in the request for service. 

8. An apparatus for network transcoding of multimedia 
data flow according to claim 7 wherein the adaptive 
pipeline comprises: 

a decoder within the service provider node 
adapted to decode multimedia data flow 
requested by the request for service in a way 
determined by the flow parameters in the 
request for service; 

a filter coupled to the decoder, adapted to filter 
multimedia data flow in a way determined by 
the flow parameters in the request for service, 
if any filtering is desired as indicated by the flow 
parameters. 

an encoder coupled to the fitter, adapted to 
encode the decoded multimedia data flow in a 
way determined by the flow parameters in the 
request for service thereby producing trans- 
coded multimedia data flow; and 
means for transmitting the transcoded multime- 
dia data flow to the network client 

9. An apparatus for network transcoding of multimedia 
dataflow according to claim 7 or 8 wherein the flow 
parameters indicate at least one of the following: 
command type, ports, media type, bit-rate, frame 
rate, resolution, end-to-end latency, interlace, sig- 
nature, loss percentage, content identification, 
code type, fitter, fitter parameter, prediction, host- 
name. 
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